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Abstract 



Cooperative cognitive radio networks are investigated by using an information-theoretic approach. 

CO 

This approach consists of interpreting the decision process carried out at the fusion center as a binary 

(asymmetric) channel, whose input is the presence of a primary signal and output is the fusion center 
decision itself. The error probabilities of this channel are the false-alarm and missed-detection proba- 
bilities. After calculating the mutual information between the binary random variable representing the 
primary signal presence and the set of sensor (or secondary user) output samples, we apply the data- 

processing inequality to derive a lower bound to the receiver operating characteristic. This basic idea is 
00 

developed through the paper in order to consider the cases of full channel and signal knowledge and 

\f\ of knowledge in probability distribution. The advantage of this approach is that the ROC lower bound 

derived is independent of the particular type of spectrum detection algorithm and fusion rule considered. 

o 

(^ Then, it can be used as a benchmark for existing practical systems. 



Index Terms 



Cognitive radio networks, Data-Processing inequality, Spectrum sensing, Sensor networks, Receiver 
Operating Characteristic. 



I. Introduction 

Cognitive Radio (CR) technologies have gained considerable interest in the last few years because 
of two factors: i) the increasing demand for wireless spectrum from a large number of applications; 
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and ii) the fact that many portions of licensed spectrum are neglected or underutilized by the regular 
licensees Q-||6j. 

The concept of CR depends considerably on the application context ATI. Nevertheless, an official 
definition has been given by the Global Standards Collaboration (GSC) group within the ITU [8]: "A radio 
or system that senses its operational electromagnetic environment and can dynamically and autonomously 
adjust its radio operating parameters to modify system operation, such as maximize throughput, mitigate 
interference, facilitate interoperability, access secondary markets." According to this definition, a CR 
device should be able to autonomously exploit unused portions spectrum to increase its own signalling 
rate without limiting the use of the radio spectrum from licensed users. Thus, the most important feature 
of a CR device is the ability to detect the availability of spectrum holes J7J, which can be accomplished 
by suitable spectrum sensing techniques. The key role of spectrum sensing has been recognized in the 
technical literature as the enabling technique for CR systems. Different strategies have been envisaged 
to effectively implement this feature and a comprehensive taxonomy can be found in fj\. 

A simple statement of the CR detection problem can be given as follows. In a CR network there 
are two classes of users: i) primary users, i.e., those users who have license rights of some other form 
of priority with respect to the radio channel access; ii) secondary users, i.e., those users who have no 
licence rights or have more limited priority to the channel access than the primary users. Secondary users 
are those who need CR capabilities, such as spectrum sensing, in order to avoid causing interference 
to primary users. Thus, secondary users have to estimate the radio channel condition before attempting 
a transmission, i.e., they need to assess whether the channel is idle or busy (hypotheses Tio and ~K\, 
respectively). This estimation is usually affected by error and characterized by two error probabilities: 

• The false-alarm probability Pf a , corresponding to the detection of hypothesis Hi when Tio is true. 

• The missed-detection probability P mc j, corresponding to the detection of hypothesis T-Lq when %i is 
true. 

Ideally, secondary users should operate toward reaching the goal of having Pf a = P mc j = 0. However, 
radio channel impairments prevent to attain this operating level, and a suitable tradeoff has to be sought. 
Typically, secondary users are allowed a maximum level of interference to the primary users, which 
translates into a maximum probability of missed detection. Then, the CR users can maximize their 
throughput by maximizing the false-alarm probability Pf a under the constraint of a given P mc |- Typical 
values of these probabilities have been set to P mc j = Pf a = 0.1 in the contest of the developing standard 
IEEE 802.22 [6]. A complete picture of the performance of a CR system is provided by the receiver 
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operating characteristic (ROC) plot. The ROC is a plot of the missed-detection probability P mc j versus the 
false-alarm probability Pf a . Its derivation depends on the radio channel parameters (fading, noise power) 
and on the type of decision process implemented to detect the presence of a primary signal. 

It has been widely recognized in the literature (see, e.g., [7 ] and references therein) that user cooperation 
enhances the performance of a CR system, both in terms of ROC, and of avoiding the hidden primary user 
problem. This problem is considered one of the major challenges to the implementation of a CR system, 
and is similar to the hidden node problem experienced in Carrier Sense Multiple Accessing (CSMA) J7J. 
The hidden primary user problem derives from the shadowing of secondary users, occurring while sensing 
the primary signal transmission. More precisely, a secondary user can be in the range of a primary user 
receiver but out of the range of another primary user transmitter. Then, the secondary user senses the 
channel idle, because it cannot capture the primary user signal, and then starts its transmission. However, 
since it is in the range of the other primary user receiver, it eventually interferes with the reception of 
the primary signal. Having multiple secondary users sensing the channel reduces the chances of falling 
into this situation. 

Fig. [T] illustrates the block diagram of a CR system based on user cooperation. We can see that the 
primary signal is present if £ = 1. This signal is received by a set of K secondary users (or sensors) which 
sample it during a certain observation window. Secondary users can exploit individually this information 
in order to make a decision on the spectrum availability. Otherwise, they can share it by sending a suitable 
signal through a control channel to a central processing unit (i.e., implementing user cooperation). This 
unit provides for the. fusion of the user information and is then called fusion center (FC) (7J. 

The goal of this paper is to analyze, by using information-theoretic results, the behavior of a cooperative 
CR system. Our approach is based on the observation that appending the decision process implemented 
at the FC to the primary signal transmission channel yields an equivalent binary channel with input £, 
the random variable indicating the signal presence, and output £, the FC decision. According to this 
interpretation, the false-alarm and missed-detection probabilities correspond to the two error probabilities 
of this binary channel (conditioned to £ = and £ = 1). In general, this channel turns out to be an 
asymmetric binary channel because the error probabilities are different. 

Then, by using the data-processing inequality, we can calculate an upper bound to the channel capacity, 
which translates into a lower bound to the ROC. This basic idea is developed through the paper in order to 
derive the lower bound of a cooperative CR system ROC, which is independent of the spectrum detection 
and fusion strategy used. This lower bound can be applied to assess the validity of specific combinations 
of spectrum sensing and fusion strategy. 
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Fig. 1. Block diagram of a cognitive radio system with input £, denoting the primary signal presence or absence, and output 
given by the set of sensor outputs yk(n) for k — 1, . . . , K and n — 1,...,N. Dotted lines represent the fading channels 
connecting the primary transmitter to the sensors (secondary users). 



The remainder of the paper is organized as follows. The system model is illustrated in Section [TTJ where 
the key concept of applying the data-processing inequality to the cooperative CR system is introduced 



and analyzed in detail. Section III deals with the derivation of the mutual information of the cooperative 
CR system without the FC channel and detection. This section considers the case of known channel 
gains and signal, as a baseline, and the case of known channel gain and signal distribution, as a further 
development. Relevant asymptotic cases are also studied, in order to mitigate the numerical difficulties 



in the derivation of the results. Section IV illustrates the analytic results through numerical examples 
including. Lower bounds to the ROC are reported in this section along with a comparison of these results 
with an energy detection estimator. Finally, our conclusions are collected in Section [Vj 

II. System model and optimum ROC 

We consider a CR system (illustrated in Fig. [TJ equipped with K sensors sensing the wireless spectrum 
over N sampling times in order to provide information about the channel availability to secondary users. 
Intentionally, the diagram does not show the terminal part consisting in the collection of the sensor 
measurements, their compacting, their transmission to the FC through a control channel, and the FC 
processing block providing the output decision about the signal presence. 

We assume a block fading channel where the nth sampled signal received by sensor k is given by 

Zk(n) £ = 

h k s(n) + z k (n) £ = 1 



Vk{n) 



(1) 
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for k = 1, . . . , K and n = 1, . . . , N. Here, Zk(n) ~ A/" c (0, a\ rjare the iid received noise samples, hk are 
the block fading gain coefficients, s(n) are the primary user's symbols, and £ denotes the the random 
variable indicating that the primary signal is present (£ = 1) or absent (£ = 0). The variances a\ are 
known parameters. We can interpret £ as the imponderable primary user decision to convey information 
through the channel at the time the CR system is trying to check the existence of a spectrum hole. 

In the following we assume that the random variable £ is not necessarily equiprobable but rather we 
have P(£ = 0) = a. Then, a represents the a priori probability of primary signal absence. 

As already mentioned, in this framework we do not consider the remaining part of the communication 
system beyond the block diagram of Fig. [T] This part consists of a distributed algorithm at the K sensors 
and at the fusion center (FC) aimed at condensing the available channel sensing information (at the 
sensors), sending it to the FC, and jointly processing in order to make a reliable decision on the presence 
of a primary transmitted signal. 

On the contrary, we regard the block diagram in Fig. [T] as a binary input-continuous output vector 
channel, which we study in order to derive the mutual information 

Z = l(i-AVk{n)} K k= l n=l ). (2) 

Using the data processing inequality (DPI) [9], we can see that the mutual information X upper bounds 
the mutual information of the channel corresponding to the completion of the transmission chain to the 
FC by any conceivable distributed algorithm. 

Completing the transmission chain up to the FC's output yields a binary-input binary-output channel. 
Denoting the FC's output by £, we have from the DPI: 

mi)<i~ (3) 

Now, by the definition of the false-alarm and missed-detection probabilities (denoted by Pf a and by P mc j, 
respectively), we have: 

' Pfa = P(t = 1 I £ = 0) 
Pmd = P(|= 0|£ = 1) 

In general, we have a binary asymmetric channel whose transition probability matrix can be written as 

'l " Pfa Pfa 

"md ■'■ ~~ " mc j 

1 Notation z ~ A/" c (/i, S) denotes a circularly symmetric complex Gaussian distributed vector with mean fj,, covariance 
matrix S = E[zz H ] - nfi H , and pdf det(TrS)" 1 exp[-(z - fi) H 'E' 1 (z - fi)]. 
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Fig. 2. ROC lower bound curves corresponding to a — 0.5 and mutual information X indicated by the labels. 



The mutual information, assuming P(£ = 0) = a, is given by (9j: 

/(£,!) = ^ b (a(l-P fa )+aP md ) 

-aH b (P fa ) - a^(P md ), (4) 

where a = 1 — a and .ff&(p) = — plog 2 p — (1 — p) log 2 (l — p) is the binary entropy function |9|. 

Finally, inserting ([4]) into inequality Q, we obtain a relationship between the false-alarm and missed- 
detection probabilities, which represents a lower bound to the ROC for the given CR system. 

The parametric dependence of the ROC lower bound on the mutual information is illustrated in Fig. 
[2] As expected, as T j 1, the ROC lower bounds decrease monotonically to Pf a = P mc j = 0. 
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III. Calculation of X 



Let us define for convenience the following matrices and vectors: 



Y 
Z 

h 



(yfc(«)) fc =i,„=i 
i t w K > N 

{z k (n)) k=hn=1 



(/ii,...,/i^) T 
a 4 ( s (l),..., s (iV)) H . 
Then, we can simplify ([T]) by writing it as follows: 

Y = £ hs H + Z, (5) 

and hence the mutual information Q becomes 

l=h(Y)-h(Y\0, 
where h(-) denotes the differential entropy Q. First, it is plain to see that 

K 

h(Y \ = h(Z) = N^log 2 (Trea 2 k ). 
fc=l 

The evaluation of h(Y) is more difficult. We distinguish among different assumptions concerning the 
distribution of the secondary channel gain vector h and the signal vector s. In the following we consider 
the cases of i) known gains and signal at the receiver, and of ii) known gain and signal distribution at 
the receiver. 



A. Known gains and signal at the receiver 

In order to equalize the noise variances, we transform the channel equation (|5]) by pre-multiplying by 
the inverse of the square root of the noise covariance matrix 

E z = diag(of, . ..,cr|-). 

We obtain 

Y = £A + Z, (6) 

where A = S 2 hs H and the entries of Z are then iid as A/" c (0, 1). This linear transformation is 
invertible and does not change the mutual information I. In order to calculate the mutual information, 



we resort to Theorem A. 1 (Appendix |A[). Since £ = 0, 1, in order to use this result we can subtract A/2 
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and obtain symmetric input. Theorem A.l tells us that the channel is equivalent to a binary-input real 
additive Gaussian channel with SNR ||A|| 2 /2. We obtain 



Hb(a) — aE 

-aE 



a 



log 2 1 + -e 
\ a 

a 



Z-\\A\\ 



log 2 1 + V-" A " : 
a 



(7) 



where Z ~ ff(0,2\\A 



I2-J2 



Remark III.l It is plain to see that Q is invariant to the mapping a \- > 1 — a, i.e., to exchanging the 
a priori probabilities of primary signal presence and absence. The ROC performance improves as these 
probabilities get closer to or to 1, as illustrated in the following. The symmetry of the resulting ROC 
lower bound suggests to define an equilibrium point corresponding to Pf a = P mc j, which is referred to as 
equilibrium probability and denoted by P eq in the sequel. Under these operating conditions, the binary 
channel ^ — > ^ is symmetric. 

Remark III.2 It is worth noting that the mutual information X, and hence the lower bound to the ROC, 
depend only on ||A|| 2 (in this case). This parameter can be written as 



SNR 



K 



|/lfc| 2 ||s| 



07 



(8) 



fc=i k 

which corresponds to the sum of the secondary users' receive SNR's. For this reason, we refer to it in 

the following by the term additive SNR. 



1) Limiting behavior for a — > 0: Expanding (|7]) for a — > we obtain: 



1 E[l-Z + SNR-e 

+ e 



Z-SNRi 



a log 2 e 

£\\ — 2e SNR ~ Z ' ~ 2 -£-2SNR 



SNR a- -(e- 



21og(2) 
1 



lW 



a 1 + 0{a 6 



log 2 e + 0(a 3 ). 



We can see that the first- and second-order approximations represent upper and lower bounds, respectively, 
to the mutual information X. These lower bounds are illustrated in Fig. [51 plotting the ratio X/a versus 
a and its second-order approximation (lower bound) for SNR = 1 (0 dB). 

2 Notation Z ~ J\f(fi,a 2 ) represents a real Gaussian random variable with mean /i and variance a 2 . 
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Fig. 3. Plot of the ratio I/a and of its second-order approximation [SNR — 0.5(e R — l)a] log 2 e versus a for SNR = 1 
(0 dB). 



2) Limiting behavior for SNR — > 00: Applying Theorem B.l (Appendix |B|), we obtain the following 
bounds: 



bK ! In 2 SNR 1 / 2 



" bK ' In 2 SNR 1 / 2 



+ 



^iraa[ir 2 + 8 + (ln(a/a)) 2 ] 1 _snr/4 



2 In 2 SNR 3 / 2 " 

These bounds yield, for SNR — ^ 00, the following asymptotic approximation: 

-SNR/4 



T U ( \ o^™ 1 

X ~ H b [a) — 2— — —7 v 



In 2 SNR 1 / 2 



(9) 
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3) Limiting behavior for a — >• and SNR — > oo: Finally, we can also expand Q for a — > at the 
equilibrium point of the ROC, and obtain 

m i) = (l-2P eq )log 2 J^ a - £~* P _i\ a 2 + Q(« 8 ). 

■eq ^"eqV-L "eqj 

When both a and P eq — > 0, we obtain the approximation 

P eq « e" SNR . (10) 



B. Known gain and signal distribution at the receiver 

The case of known gain and signal distribution at the receiver can be handled by exploiting the results 



derived in Section 



III-A 



First, we notice that A = S z hs H is a random matrix whose joint pdf of 



the entries depends on the distributions of the channel gain vector h and of the signal vector s. Then, 
starting from ([7]), we can apply the chain rule for the mutual information and the independence between 
£ and the vectors h, s in order to obtain the following result: 

X = I(Z;A) + I(£;Y\A) 

= i(t;Y\A) 



H b {a) - E 



alp^fe^*-) 



+ alog 2 (l + |e^^- r ) 



(11) 



where Z\ ~ A/" c (0, 1) is independent of V = || A\\ 2 , and the average is with respect to both Z\ and T. In 
accordance with eq. ((8), we have 



K " i2|| ||2 



r = y^ ^ fc 



2 ' 

fe=l °" fc 
but in this framework Y is a random variable whose mean value is defined as the additive SNR, i.e., 

SNR = E[T]. 

The lower bound to the ROC depends on the distribution of V. Some examples illustrate this dependence 
in Section [iVJ 

IV. Numerical examples 

In this section we illustrate the ROC bound obtained by numerical examples in order to compare the 
lower bounds obtained with some real estimation scheme. 
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Fig. 4. ROC lower bound in the case of known channel gains and signal for different values of the additive SNR (reported on 
the plot) and a priori probability of primary signal absence a = 0.5. 



A. Known gains and signal at the receiver 

The first example reported in Fig. [4j which consider the case of known channel gains and signal 



(Section III-Ai with a priori probability of primary signal absence a = 0.5. It can be noticed that the 
curves are symmetric with respect to exchanging the probabilities Pf a and P mc j. We can also notice a 
threshold behavior with respect to the SNR, which is better illustrated in Fig. [5] The SNR threshold 
lies between 5 and 10 dB: below the threshold, the equilibrium probability decreases slowly; above the 
threshold, the decrease rate becomes faster. The curves in Fig. [5] are lower bounds to the equilibrium 
probability versus the additive SNR for different values of the probability of signal absence (or presence) 
and in the asymptotic case of a — > 0, which is given by eq. dTOb. 
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Fig. 5. Lower bound to the equilibrium probability P eq versus the additive SNR with a priori probability of primary signal 
absence (or presence) a = 0.5,0.1, 10~ 2 , 10~ 3 (solid curve). The dashed curve corresponds to a — > (asymptotic case). 



B. Comparison with an energy detection scheme 

A simple spectrum sensing scheme based on energy detection corresponds to the following estimation 



rule: 



e 



0, \\Y\\ 2 <6 + lna 



(12) 



1, ||F|| 2 > 6» + lna 
From the equivalent channel equation i|6]), the resulting false-alarm and missed-detection probabilities are 

given by: 

' P fa = P{\\Z\\ 2 > 6 + \na) 

P md = P(\\A + Z\\ 2 <6 + lna) 
Since \\Z\\ 2 and \\A + Z\\ 2 are central and noncentral ^-distributed random variables, we can find 
explicit expressions of the two probabilities. In fact, the cdf 's can be found in standard textbooks, such 



e 



(13) 
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as fTO] . We have: 

P{\\Z\\ 2 <u)= 1 {KN,u), 

where 7(71, x) = T{n)~ l f°° u n ~ 1 e~ u du is the normalized upper incomplete Gamma function, and 

P(\\A + Z\\ 2 <u) = l- Q KN (y/2\\A\\ 2 , V2u), 



where Q m (a,b) = j'^° x(x/a) m x e ( x +a )' 2 / m _i(ax)dx is the generalized Marcum's Q function de- 
fined in (TOj. 

Figures [6] and [7] show the ROC corresponding to an energy detector spectrum sensing scheme for 
two values of the product KN and SNR = and 10 dB, respectively. The diagrams also report the 



information-theoretic lower bound derived in Section III-A We can see that increasing the product KN 
for a fixed SNR degrades the resulting ROC. This can be understood by observing that the variances of 
|| A + Z|| 2 and \\Z\\ 2 are proportional to KN (they are (1 + 2SNR)iTA^ and KN, respectively), while 
the mean value difference is equal to SNR. Therefore, as the KN increases, the overlapping of the two 
pdf 's increases, and hence the probabilities of false-alarm and missed-detection. 

Remark IV.l It is worth noting that the previous results hold for fixed additive SNR. Then, increasing 
either K or N implies that the individual secondary user SNR's |^<A;| 2 || s l| 2 / cr fc must decrease to keep 
the overall additive SNR constant. On the contrary, if one fixes the individual SNR's, the additive SNR 
increases and both the lower bound and the energy-detector ROC improve. Thus, the fact that the ROC 
curves decrease as KN increases shall be interpreted by saying that the energy detector performance 
would improve if we could concentrate all the available sensors in a single one by keeping the total 
additive SNR constant. 

C. Known gain and signal distribution at the receiver 

Here we consider the case of iid Rayleigh fading gains, where 7^ = E[|/ifc| 2 ]/o- 2 , and ||s|| 2 has 
probability distribution .?-*( || s|| 2 = S m ) = p m for m = 1,...,M. If we assume that all the 7^ are 
different, the pdf of T can be derived as follows: 

( G \ = ST^ V^ exp(-G/(jkSm)) rr 1 

m=\ fe=l H^k 
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Fig. 6. ROC obtained with an energy detector with SNR = dB, KN = 1 and 10, and a — 0.5. Solid lines are obtained 
analytically and markers correspond to Monte-Carlo simulation results. The lowest dashed curve corresponds to the information- 
theoretic lower bound. 



We can use this result to calculate the double integral 

"°° exp(-z 2 /2) 

-oo 



H b (a) 



alog 2 1 + -e % 
a 



i a ■ 
+ a logo 1 + — e 
a 



'2Gz-G 



As an illustrative example, we consider the following scenario: 
• K = 4 secondary users. 
. 7fe = (4 + k) dB for k = 1, . . . , K. 



• \\s\ 



1. 



Pv{G) 



dG dz. 



(14) 
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Fig. 7. Same as Fig. |6]but SNR = 10 dB. 



The ROC curves are reported in Fig. ffl The lowest curve corresponds to the lower bound calculated by 



using (JT4J). The other curves correspond to the implementation of a spectrum sensing algorithm based 
on energy detection for different combinations of the number of secondary users K and sampling times 
N. In all cases, the same additive SNR is assumed, SNR = X]fc=i7fc> namely, 

101og 10 (10 - 5 + lO ' 6 + 10 - 7 + lO 08 ) = 12.66 dB. 



As already noticed in Remark IV. 1 the best operating condition for the energy detector corresponds to 
the case of K = N = 1 (at fixed additive SNR). 



V. Conclusions 

In this work we proposed an information-theoretic method to derive a lower bound to the receiver 
operating characteristic of a cognitive radio network based on cooperative sensors. The bound stems from 
the application of the data-processing inequality to the binary asymmetric channel arising by considering 
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Fig. 8. ROC curves corresponding to a = 0.5, K = 4 secondary users, and Rayleigh fading. The solid curve is the lower 
bound. The other curves correspond to energy detection (ED) with different combinations of K and N and constant additive 
SNR (12.66 dB). 



the primary signal presence as a binary input and the fusion center decision on the signal presence as a 
binary output. The bound takes into account the possible knowledge of the a priori probability of primary 
signal presence and applies to every kind of single-input multiple-output channel connecting the primary 
signal to the multiple cooperative sensors (i.e., the secondary users of the cognitive radio system). 

Key advantages of this approach are: i) independence from the implementation of the connection 
between the sensors and the fusion center; and ii) independence from the fusion rule. Both features 
derive from the information-theoretic method we have followed, based on the equivalence between the 
actual channel model (connecting the primary transmitter to the sensors and then to the fusion center) 
and the binary asymmetric channel with error probabilities corresponding to the false-alarm and missed- 
detection events. 

In order to illustrate this basic idea, we considered two scenarios of interest for cognitive radio networks: 
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1) The case of full channel gain and primary signal information at the fusion center. 

2) The case of full distribution information about the channel gain and the primary signal at the fusion 
center. 

The first case has been investigated in full detail by deriving the mutual information X between the 
primary signal presence variable £ and the set of sensor observations Y. This expression has been 
analyzed asymptotically, both for large additive SNR and for vanishing a (probability of signal absence). 
The asymptotic expression for large additive SNR, eq. ([9]), is based on an integral which is an extension 



of the one calculated in [11 Prob. 4.12]. In essence, this expression can lead to an asymptotic expansion 
of the mutual information of the binary symmetric channel for large SNR. Full details on the derivation 
are reported in Appendix [B] 

In the second case, a general expression of the mutual information X required to obtained the receiver 
operating characteristic lower bound has been derived as the average value of an expression depending 
on two random variables (the random additive SNR F and the auxiliary Gaussian random variable Z\). 
This average leads to a double integral, which has been expanded in detail in the case of iid Rayleigh 
distributed channel gains. In the numerical results section, the distribution of V is reported in a fairly 
general case, and numerical results are included for illustration purposes. 

Finally, it is worth mentioning that the series expansion of the mutual information of a binary input 



additive Gaussian channel (Theorem B.l I is also a novel contribution of this paper. It extends the series 



expansion of the capacity of the same channel, which can be found in 1 1 1 Prob. 4.12]. In the present 
context, this series expansion is needed to account for the possible knowledge of the a priori probability 
of primary signal presence, which is available in several cognitive radio system and worth being used to 
improve the quality of the decision rule at the fusion center. 

Appendix A 
Equivalence of binary input Gaussian channels 

In this appendix we show that a binary-input, vector-output additive Gaussian channel is equivalent, as 
far as concerns the mutual information, to a binary-input additive Gaussian channel with scalar output. 
Let the binary input be X = ±1 with a = P(X = -1) and a = 1 - a = P(X = +1). 
Let the channel equation be 

y = Xa + z, (15) 

where a G R nxl is a given constant vector and z is a vector of iid Gaussian random variables distributed 

as A/"(0,1). 
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The mutual information is given by 

I(X; y) = h(y) - h(y\X) = h(y) - h(z). 

We know that h(z) = (n/2) log 2 (27re). To calculate h(y), we note that 

aexp(— \\y + a|| 2 /2) + aexp(— \\y — a|| 2 /2) 



Hence, 



p y (y) 



i(X;v) 



(2tt)«/ 2 



-E 



log 2 (ae-" y+a ll 2 / 2 + ae-Wy-^ 2 ' 2 ) 



n log 2 e 



Hb(a) — a E 

-oE 



bg9 f 1 + « e 2a T -2||a| P 

a 



log I 1 + a e 2a^-2||a|P 
Q 



(16) 



The scalar product a J z is a real Gaussian random variable with zero mean and variance ||a|| 2 . 
Similarly, we can find the mutual information of the channel 



Y = aX + Z, 



(17) 



where aeR and Z G A/"(0, 1). In this case, 

I(X;Y) 

= -E 



log 2 (ae-( y+a ) 2 / 2 + ae-( y - a ) 2 / 2 
Hb(a) — a E 

-oE 



log 2 e 



log 2 1 + -e' 
a 



l og2 ( 1 + %2aZ-2a> 

a 



(18) 



Then, the mutual information eqs. ( fT6] ) and ( [T8] ) coincide provided that a 2 = \\a\\ 2 . These results are 
summarized by the following theorem. 

Theorem A.l A binary-input vector-output additive Gaussian channel y = Xa + z, where the entries 
of z are iid and distributed as A/"(0, 1), is equivalent, in terms of mutual information, to a binary-input 
real additive Gaussian channel with SNR 7 = ||a|| 2 . The mutual information is: 



I(X;Y) = H b (a)-aE 



log 2 l + ^eW- 2 ^ 
a 



-qE 



log 2 1 + -e 
a 



a 2^1-27 



(19) 
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where Z\ ~ A/"(0, 1). 

Remark A.l The equivalence between the scalar and n- vector channels in terms of mutual information 
can be predicted by observing that the vector channel is a combination of n parallel Gaussian channels. 
Then, provided the receiver knows the vector a, the useful part of the signal can be combined coherently 
at the receiver while the noise is combined incoherently This implies an n-fold increase of the SNR, for 
a given mutual information, when passing from the scalar to the n-vector channel. 

Appendix B 



Asymptotic approximation of ( 19) 



In this appendix we derive an asymptotic approximation of the mutual information ( fT9| ). This result 
extends pT| Prob. 4.12], corresponding to the equiprobable input case. 



Theorem B.l The asymptotic expansion of ( |19| ) for 7 — >■ 00 is given by 

n=0 ' 

where 

Ma) = ^r??rfo?V 2(n - fe) i^ 

y J n!ln2 *—> \2kJ ' ' 



(20) 



2(n-fc)l 
fc=0 
k 

x S ^ j 2 2m {2k)^ m \\n{a/a)) 2{k - m) . (21) 

m=0 



Consecutive partial sums in (20) are lower and upper bounds to I(X; Y). 
Proof: We start by considering the integral 

/oo 
ln(l + p e 2 " 27 )e- 
-00 



a *-2 7 V-« a /(87)_^_ 



V8^7 



-00 

''"ln(l + /3 e 2 )e-^ +2 ^ 2 /(87)^ 

ln (l + /9e -) e - 2 /(87)-/2-7/2^^ 



00 



(-1)" Cnjp) /2 



^ (8 7 )" +1 / 2 



where 



1 /"°° z 2n 



cn(p) = T" / ln ( X + P e ") -T e "" /2 ^- C 23 ) 



2vr ./.oo n 
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Since consecutive partial sums of the series expansion of e~ x are lower and upper bound of the limit, 
also consecutive partial sums of p2~] ) are lower and upper bounds of the lhs. 
To calculate the coefficients c n (p), we notice that 



CM 

1 f'°° z 2n 



4-7T n\^fp J^ac cosh((z + lnp)/2) 
1 f°° (2u-lnp) 2n 



dz 



-du 
2-7T rv.^fp J_ 00 cosh-u 

2 ™ ! ^f^W V P> 7-ooCoslu/ 



oo u 2k 

du 



II 



1 ^(2n\ 2k(^P) 2(n ~ k \r, , 

> U - — — \E 2 k\ (24) 

2n\^ o \2kJ Jp ' 2fc| 



by using the integral [12 3.523-4] 



x u 2fc . Jv\ 2k ^ 



cosn u \ 2 J 

for every integer k > 0, where i£ n is the nth Euler number (Eq = 1, E 2 = — 1, Kj = 5, -Eg = — 61, . . . ). 
Since we have: 

/ [ ^-du = 2^Y(-l) k 2 k n^(lnx) n - k , 

for every integer n > and with n( m ) = (n!/(n — m)!), we can integrate ([24]) term by term and obtain 
the following final expression: 



vpy 2n! ^ \2fc/ ' ' /n Ju 



; — n V / 



J 2(n-k)\ 
k=0 
2k 

xJ2(-l) m 2 m (2k) ( - m \lnp) 2k - m . (25) 



m=0 

In the special case of p = 1, we have: 

n 



c n (l) = i^2 2i (2n)( 2i )^-^ 2M )|. 
' fc=0 
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Then, in accordance with |11 Prob. 4.12], where c n corresponds to c n (l)/2 2n , we have: 

co(l) = 1 

Cl(l) = 8 + 7T 2 

c 2 (l) = 384 + 48vr 2 + 5vr 4 

c 3 (l) = 46080 + 5760vr 2 + 600vr 4 + 61vr 6 



Finally, we apply (|25|) to derive the asymptotic expansion (20 1 and the coefficients (21 1. 
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